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Abstract 

The solutions of parabolic and hyperbolic stochastic partial differ- 
ential equations (SPDEs) driven by an infinite dimensional Brownian 
motion, which is a martingale, are in general not semi-martingales 
any more and therefore do not satisfy an Ito formula like the solu- 
tions of finite dimensional stochastic differential equations (SODEs). 
In particular, it is not possible to derive stochastic Taylor expansions 
as for the solutions of SODEs using an iterated application of the Ito 
formula. However, in this article we introduce Taylor expansions of 
solutions of SPDEs via an alternative approach, which avoids the need 
of an Ito formula. The main idea behind these Taylor expansions is 
to use first classical Taylor expansions for the nonlinear coefficients of 
the SPDE and then to insert recursively the mild presentation of the 
solution of the SPDE. The iteration of this idea allows us to derive 
stochastic Taylor expansions of arbitrarily high order. Combinatorial 
concepts of trees and woods provide a compact formulation of the 
Taylor expansions. 

Taylor expansions, stochastic partial differential equations, SPDEs, strong 
convergence, stochastic trees 
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1 Introduction 



Taylor expansions are a fundamental and repeatedly used means of approx- 
imation in mathematics, in particular in numerical analysis. Although nu- 
merical schemes for ordinary differential equations (ODEs) are often derived 
in an ad hoc manner, their convergence orders are determined by Taylor ex- 
pansions of the solution of an ODE. An important component of these Taylor 
expansions are the iterated total derivatives of the vector field corresponding 
higher derivatives of the solution, which are obtained via the chain rule, see 
Deuflhard & Bornemann (2002). 

An analogous situation holds for Ito stochastic ordinary differential equa- 
tions (SODEs), except, due to the less robust nature of stochastic calculus, 
the stochastic Taylor expansions here are obtained via iterated application 
of the stochastic chain rule, the Ito formula (see Kloeden & Platen (1992)). 
Underlying this method is the fact that the solution of an SODE is an Ito pro- 
cess or, more generally, a semi-martingale and, particular, of finite quadratic 
variation. 

Therefore, this approach fails, however, if an SODE is driven by an additive 
stochastic process with infinite quadratic variation such as a fractional Brow- 
nian motion, because the Ito formula is no longer valid. A new method to 
derive Taylor expansions in such cases was presented in Jentzen & Kloeden 
(2007, 2008a). It uses the smoothness of the coefficients, but only minimal 
assumptions on the nature of the driving stochastic process. The resulting 
Taylor expansions there are thus robust with respect to assumptions con- 
cerning the driving stochastic process and, in particular, remain valid for 
other noise processes. The main idea in Jentzen & Kloeden (2007) is to use 
classical Taylor expansions for the coefficients of the SODEs (driven by an 
additive Holder continuous stochastic process) and then to insert recursively 
lower order expansions into that classical Taylor expansions. 
In the case of stochastic partial differential equations (SPDEs) the situation 
is different from the finite dimensional setting. In this article we consider 
SPDEs of the form 

dUt = [AUt + FiUt)] dt + BiUt) dWt, Uo = uq (1) 

on a Hilbert space H and where A is in general an unbounded linear operator 
(for example A = A), F, B are nonlinear continuous functions and Wt is a 
cyhndrical Wiener process (see section [2]for a precise description of the equa- 
tion above and the assumptions we use). The interesting thing here in the 
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infinite dimensional setting is, that although the SPDE ([T]) is driven by the 
martingale Brownian motion, the solution process is not a semi-martingale 
any more (see Gradinaru et al. (2005) for a clear discussion of the problem) 
and therefore a general Ito formula does not exist for its solutions, just spe- 
cial cases (see Gradinaru et al. (2005) and also Prevot & Rockner (2007)). 
Hence stochastic Taylor expansions for the solutions of the SPDE ([T]) cannot 
be derived as in Kloeden & Platen (1992) for the solutions of finite dimen- 
sional SODEs. Consequently, until recently, only temporal approximations 
of low order have been derived for the solutions of such SPDEs (except for 
SPDEs with only finitely many stochastic processes, see for example Gyongy 
(2003) or see also Bayer & Teichmann (2008) for finitely many stochastic 
processes and weak convergence). 

The main idea of the Taylor expansions presented in this article is to use 
classical Taylor expansions for the coefficients F and B in the mild integral 
equation version of the SPDE above and then to insert the mild presentation 
of the solution process into these classical Taylor expansions (see section 3 
for a detailed presentation of these Taylor expansions). In the case of SPDEs 
with additive noise this approach was recently introduced in Jentzen & Kloe- 
den (2008c). Moreover, numerical schemes based on these Taylor expansions 
there have already been introduced in Jentzen & Kloeden (2008b) and in 
Jentzen (2008). Indeed, it can be seen from a theoretical point of view and 
in simulations that these Taylor expansions lead to higher order numerical 
schemes for SPDEs with additive noise (see for example section 4.3 in Jentzen 
(2008)). Here, we consider the case with general noise, where the technical 
difficulty is to estimate the reminder terms of the diffusion coefficient B inside 
the infinite dimensional stochastic integral. To sum up: with this approach 
we avoid the need for an Ito formula but nevertheless we can derive stochastic 
Taylor expansions of arbitrarily high order for the solution of the SPDE ([T]). 
The paper is organized as follows. In the next section, we describe precisely 
the SPDE that we are considering and state the assumptions that we require 
on its terms and coefficients and on the initial value. Then, in the third 
section, we sketch the idea and notation for deriving simple Taylor expan- 
sions, which we develop in section four in some detail using combinatorial 
objects, specifically stochastic trees and woods, to derive Taylor expansions 
of an arbitrarily high order. We also provide an estimate for the reminder 
terms of the Taylor expansions there. (Proofs are postponed to the final 
section). These results are illustrated with some representative examples in 
the fifth section. Numerical scheme based on these Taylor expansions will be 
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discussed elsewhere. 

2 Setting and Assumptions 

Fix T > and let P) be a probability space with a normal filtration 

Tt-, t G [0, T], see e.g. Da Prato & Zabczyk (1992) for details. In addition, let 
[H, (•, •)) be a separable Hilbert space with its norm denoted by |-|. Moreover, 
let {D, be a separable Banach space with H C D continuously. Then, 
we consider the SPDE ([1]) in the mild integral equation form 



on H, where Wt, t G [0, T], is a cylindrical Q- Wiener process with Q = I with 
respect to J-'t, t G [0, T] on another separable Hilbert space ({/, (■, ■)) (space- 
time white noise) and the objects A, F, B and mq are specified through the 
following assumptions. Here L{U, D) denotes the space of all bounded linear 
operators from U to D. 

Assumption 1. (Linear Operator ^4) Let I be a countable set. Moreover, 
let {Xi)i^x be a family of positive real numbers with infjgjAj > and let 
{ei)i(zx be an orthonormal basis of H. Then, suppose that the linear operator 
A : D{A) G H ^ H is given by 



for alive D{A) with D{A) = [v e H\ EieJ I^^H (^i, < oo] . 

Assumption 2. (Drift F) The nonlinearity F : H H is infinitely often 
Frechet differentiable and its derivatives satisfy snp^^fj {v)\ < oo for all 
i G N. 

Let D{{—AY), r G M, denote the interpolation spaces of powers of the 
operator —A, see for example Sell & You (2002) and let |-|^^ denote the 
Hilbert-Schmidt norm for Hilbert-Schmidt operators from U to H. 

Assumption 3. (Diffusion B) Suppose D C D((— A)"*") continuously for 
some r > 0. Moreover, let B : H ^ L{U,D) be infinitely often Frechet 




a.s. (2) 
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dijferentiable and suppose that e^*S«(f)(«;i, ...,Wi) and {-Aye^*B{ v) are 
Hubert- Schmidt operators from U to H such that 

\e^'B^'\v)iw,,...,Wi)\^^^ < Li {l + \v\)\w,\...\wi\t^'-'^\ 
\e'^'{B{v)-B{w))\^g < Lo \v - w\ t'-'^'^\ 

< Lo(l + |t;|)t(^-5) 

for all V, w, Wi, . . . ,Wi E H , i > and t G (0, T] with constants Lq, Li, . . . > 
0, 6e (0,i], 7G (0,1) andee (0,i). 

Assumption 4. (Initial value uq) LetuQ : Q —>■ D{{—A)'') be a J-'o-measurable 
random variable with the property that E,\{—Ayuof < oo for every p > 1 
and 7 G (0, 1) given in Assumptions^ 

Later, it will be clear, that it would suffice to postulate that only the 
ffist K-derivatives of F and B are bounded in the sense above with K E N 
sufficiently high, but for simplicity we use Assumption [2] and Assumption [3J 
Although similar assumptions are used in the literature on the approxima- 
tion of this kind of SPDEs (see for example Assumption H1-H3 in Hausenblas 
(2003) or see also Lord & Shardlow (2007), Jentzen & Kloeden (2008b) and 
Miiller-Gronbach & Ritter (2007b)), these assumptions here are in a way 
not satisfying, since the nonlinear terms F, B have to be global Lipschitz 
continuous and Frechet differentiable on the space H, which is not so of- 
ten fulffiled in applications. However as in Kloeden & Platen (1992), we 
present here a Taylor expansion with strong assumption and then one can 
use localization techniques as in Gongy (1998) or in Jentzen et al. (2008) 
to show convergence under less restrictive assumptions. Furthermore, note 
that the stochastic heat equation with additive or particularly multiplicative 
noise is a non trivial example, which satisfies for example these assumptions 
(see section [5]) . Note also that Assumption [3] is in that way elegant that in 
contrast to Theorem 7.4 and Theorem 7.6 in Da Prato & Zabczyk (1992) 
it combines space time white noise and trace class noise in one setting (see 
Jentzen & Kloeden (2008d)). While in the case of space time white noise one 
usually requires somethings on e"^* and while in the case of trace class noise 
one usually requires somethings on -B(-), here we use Assumption |3l which 
postulates somethings on e^*i?(-). In that way both cases are here handled 
in one setting. 

Now, we present some properties of the solution and some notations and 
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then start with the Taylor expansions in the next section. A solution of the 
SPDE ([T]) (under the Assumptions [T}|1]) is a predictable (with respect to Tt) 
stochastic process ?7 : f2 x [0, T] i7 with supo<t<TlE \Ui\ < oo and which 
satisfies 



P 



Ut = e^'uo+ [ e^^'-''>F{Us)ds+ [ e"^^'-'^ B{Us)dWs =1 
Jo Jo 



for all t G [0,T]. Under the Assumptions [TH there is an up to modifications 
unique stochastic process U : fl x [0,T] ^ H, which is a solution of the 
SPDE ([1]) in the sense above and furthermore satisfies 

sup \{-AyUt\L,< oo (3) 

0<t<T 

for all p > 1 (see Jentzen & Kloeden (2008d)), where 7 G (0, 1) is given 

in Assumption [3] and where \Z\j^p := (E|Z|''')p is the L^-norm of a random 
variable Z : Q ^ H. Henceforth we fix G [0, T) and denote by V the set 
of all equivalence classes of predictable stochastic processes 

X : nx [to,T] H with sup {Xtl^^ < 00 Vp > 1, 

to<t<T 

where two processes are in one equivalence class if they are modifications of 
each other. Finally, we define the finite constants 

K, := sup \F^'\v)\ and := sup (|(-A)^f/t|^, + |f/t|^0 (4) 

vGH 0<t<T 

for all i G M. 



3 Taylor expansions 

In this section we present the notation and basic idea behind the derivation 
of the Taylor expansions. We write 

AUs:=Us-Ut„ As -.= 3 -to 

for s G [to, T] C [0, T], thus AU denotes the stochastic process AUt, t G [toi 7"]- 
Here and below U is always the unique solution process of the SPDE ([1]). 
Note that AU is in V. Firstly, we introduce some integral operators and an 
expression relating them, and then we show how they can be used to derive 
some simple Taylor expansions. 
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3.1 Integral Operators 

Let j G {0, 1, 2, 1*, 2*}, where the indices {0, 1, 2} will label expressions con- 
taining only a constant value or no value of the SPDE solution, while 1* and 
2* will label certain integrals with time dependent values of the solutions in 
the integrand. Specifically, we define the stochastic processes 1° in V by 

for each s G [to,T]. Given i e N and j e {1,2,1*, 2*}, we then define 
the z-multilinear symmetric mapping /* : "P* := P x ■ — x P — > V with 

j-times 

Ij[9i, ■ ■ ■ , gi\is) by 

1 feMs-r)pi^^Ut,){gi{r),...,g,{r)) dr 
when J = 1 respectively 

when j = 2 and 

when j = I* respectively 

It '^^'"^ (/ ' ^^^^^"^ ^ ^^^^'^ ■ ■ ■ ' ^^^""^^ 

when j = 2* for all s G [toi^] and gi,...,gi in P. Due to Assumptions 
HH one can check that the stochastic processes /j* and the mappings /j are 
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well defined. The proof that the processes /j are predictable (and in V) is a 
little tricky: one shows that these processes are mean square continuous by 
using the Assumptions [2] and [3] and this yields that they have a predictable 
version. In the next step, we consider the mild solution of the SPDE ([1]), 
which obviously satisfies 

Af/, = (e^^^ - J) Ut, + r e^'^'-'^FiUr) dr + f e^^'-'^B{Ur) dWr (5) 

J to J to 

almost surely, or, in terms of the above integral operators, 

AUs = /o°(s) + (s) + 4 (s) a.s. 

for s G [to 5 which we can write symbolically in the space V as 

A[/ = /° + /?,+4. (6) 

The stochastic processes Jq, Ij[gi, . . . , gi] for j = 1 or 2 and z > only depend 
on the solution at time t = t^. These terms are therefore useful approxima- 
tions for the solution Us- However, the stochastic processes /{, [(71, ... , gi\ and 
/g* [gi, . . . , gi\ with i > depends on the solution path Us with s G [to, 7"]- In 
that sense the star * at the number 1 and 2 denotes that we need a further 
expansion for these processes. For this we will use the important formulas 

4 = J° + A\[A[/] 

= /? + aM/°] + /MA°.] + AM4], (7) 
= j° + 4 [4 + 4 [/?*] + 4 [4], (8) 

which are an immediate consequence of integration by parts and equation 
([6]), and more generally the iterated formulas 

Il4g,,...,g,] = Il[g,,...,g,]+Ilt'[AU,g,,...,g,] 
= Il[g^,...,g,]+Ilt'[l'o,gi,...,g^] 

+/i+i[4, (71, ...,g.] + I\t\ll,,g^, . . . ,^.] (9) 
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li* [gi,---,9i\ = 4[9i,---, 9i] + ^2^MAf^, 9l,■■■,9^] 
= Il[gi,...,gi\+Ilt'[I^,gi,...,gi\ 

+P,t'[P,„g,, ...,g..] + Ilt^[ll,.9u ■■■.9^] (10) 

for 5(1, . . . in "P, i > 1. 

3.2 Derivation of simple Taylor expansions 

To derive a further expansion of equation ([6]) we insert formula ([7]) to the 
stochastic process I^, and we insert formula ([H]) to the stochastic process J^*, 

/f. = /f + /iM/o°] + AM/?.] + /iM4], 
4 = /° + 4[/o°] + 4[/?.] + 4[4] 

into equation ([6]) to obtain 

At/ = /°+(/? + aM/o°] + /Ma°.] + aM4]) 
+ (/° + 4[/o°] + 4[A°.] + 4[4]), 

which can also be written as 

AU = J° + /? + + R (11) 

with 

R = [I'o] + [lU + il* [4] • + 4 [/o°] + 4 [4] + 4 [4] • 

If we can show that the double integral terms Jj [/°] in R are sufficient small 
(indeed, this will be done in the next section), then we obtain the approxi- 
mation 

J° + /? + /°, (12) 
or, using the definition of the stochastic processes /°, 

J to J to 
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for t G [to) Hence 



Ut ^ e^^'Ut, + (e^^* - J) F(t7,,) + f e^^'-^'> B{Ut,) dWr, t G [to, T] 

J to 

(13) 

is an approximation for the solution of SPDE ([1]). Since the right hand side 
of equation f[T^ depends on the solution only at time to, it is the first non 
trivial Taylor expansion of the solution of the SPDE ([T]). The reminder terms 
/j[J°] in R of this approximation can be estimated by 

\R{t)\L2 < C(At)('^+™'^('''''» 

for t G [to, T] and with a constant C > (see Theorem [1] in the next section). 
We write Yt = 0{{AtY) with r > for a stochastic process y in P if 
1^*1x2 — C{AtY holds for all t G [to,T] with a constant C > 0. Therefore, 
we have 

Ut-l^e'^^'Ut, + A-^ (e^^* - /) F{Ut,) + j'e^'^'-'^ B{Ut,) dWr^ = 0((At)('^+"""(^'^))), 
or 

Ut = e^^'Ut,+A-' (e^^* - /) F{Ut,)+ f e^^'-'^ B{Uto) dWr+OiiMf^'^'^^^'^^). 

J to 

(14) 

The approximation f|T3|) thus has order 5 + min(7, 5) in the above strong 
sense. It plays an analogous role to the simplest strong Taylor expansion 
in Kloeden & Platen (1992) on which the Euler-Maruyama scheme for finite 
dimensional SODEs is based and was in fact in the case of additive noise 
used in Jentzen & Kloeden (2008b) to derive the exponential Euler scheme 
for the SPDE (p. 



3.3 Higher order Taylor expansions 

Further expansions of the reminder terms in a Taylor expansion give a Taylor 
expansion of higher order. To illustrate this, we will expand the terms /g* [/q] 
and /2*[/2*] in R in equation ffTTl) . From ([8]) and ffTOj) we have 

4 K] = K] + 4 [il I'o] + 4 [4 , /o°] + 4 [4 , 1'o] 
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and 




iM] + 4 [4 [4] + /2 4[4]] + /2[4[4]] 

, r2 rrO rO 1 , 7-2 rrO rO 1 , r2 r rO rO 1 
T^-'2* [-'O ' -'2*J -'2* [-'1* ' -'2*J -'2* [-'2* 5 -'2* J 5 



which we insert into equation (fTTl) to obtain 



At/ 



where the reminder term R is here given by 



R = 4 [I'o] + m + [4] + 4 [4] + 4 [/o°, /o°] + 4 [4 , 1'o] + 4 [4 , Q 
+il [4 [/o°]] +4 [4 [4]] +4 [4 [4]] +4 [/o°, 4] +4 [4 , 4] +4 [4 , 4] • 



From Theorem[I]in the next section we will see that R{t) = 0((At)('^+2™'^('^''^))). 
Thus we have 



for t G [to)2^]- This approximation is of order S + 2min(7,<5). The double 
integral dWr dWg indicates that this Taylor expansion is in a way the infinite 
dimensional analogon of the Milstein scheme for SODEs. 

By iterating this idea we can construct further Taylor expansions. In partic- 
ular, we will show in the next section how a Taylor expansion with arbitrary 
high order can be achieved. 



AU = /° + /? + + 4[4 + 1^] + 0((At)(''+2min(7,5))^^ 



which can also be written as 
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4 Systematic derivation of Taylor expansions 
of arbitrary high order 

The basic mechanism for deriving a Taylor expansion for the SPDE ([1]) was 
explained in the previous section. We will now show how Taylor expansions 
of arbitrary high order can be derived and will also estimate their reminder 
terms. For this we will identify the terms occurring in a Taylor expansions by 
combinatorial objects, i.e. trees. It is a standard tool in numerical analysis 
to describe higher order terms in a Taylor expansion via rooted trees (see, for 
example. Butcher (1987) for ODEs and Burrage & Burrage (2000), RoBler 
(2001, 2004) for SODEs). In particular, we introduce a class of trees which 
is appropriate for our situation and show how the trees relate to the desired 
Taylor expansions. 

4.1 Stochastic trees and woods 

We begin with the definition of the trees that we need, adapting the standard 
notation of the trees used in the Taylor expansion of SODEs (see for example 
Definition 2.3.1 in RoBler (2001) as well as Burrage & Burrage (2000), RoBler 
(2004)). 

Let G N be a natural number and let 

t' ■.{2,...,N}^{1,...,N}, t": {l,...,iV}^{0,l,2,r,2*}, 

be two mappings with the property that t'{j) < j for all j G {2, . . . , A^}. 
The pair of mappings t = (t',t") is a S-tree (stochastic tree) of length = 
/(t) nodes. 

Every S-tree can be represented as a graph, whose nodes are given by the 
set nd(t) := {1, . . . , A^} and whose arcs are described by the mapping t' in the 
sense that there is an edge from j to t'{j) for every node j G {2, . . . , A^}. The 
mapping t" is an additional labelling of the nodes with t"{j) G {0, 1, 2, 1*, 2*} 
indicating the type of node j for every j G nd(t). The left picture in Figure 
[U corresponds to the tree ti = (t[,t'() with nd(ti) = {1,2,3,4,5} given by 

t;(5) = 2, t;(4) = i, t;(3) = 2, t;(2) = i 
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Figure 1: Two examples of stochastic trees 



and 



t;'(i) = i, t';(2) = r, t'/(3) = 2, t';(4) = o, t;'(5) = 2*. 



The root is always presented as the lowest node. The number on the left 
of a node in Figure [H is the number of the node of the corresponding tree. 
The type of the nodes in Figure [1] depends on the additional labelling of the 
nodes given by More precisely, we represent a node j G nd(ti) by (S) if 
t'lij) = 0, hy if t'lU) = 1, by O if t'lij) = 2, by ■ if t'Hj) = 1* and finally 
by □ if t'l{j) = 2*. The right picture in Figure [T] corresponds to the tree 
t2 = (tg, with nd(t2) = {1, . . . , 7} given by 

t^(7) = 4, t'2(6) = 4, t^(5) = 1, t'2(4) = 1, t^(3) = 1, t'2(2) = 1 



t'2'(l) = 0, t^'(2) = 0, t^'(3) = 2, t^'(4) = 1, t'2'(5) = r, t^'(6) = 1, t^'(7) = T. 



We denote the set of all stochastic trees by ST and will also consider a tuple 
of trees, i.e. a wood. The set of S-woods (stochastic woods) is defined by 



Of course, we have the embedding ST C SW. A simple example of an S- 
wood which will be required later is wq = (ti, 12,13) with ti, t2 and ts are 



given by /(ti) = /(t2) = /(tg) = 1 and t'/(l) = 0, t^'(l) = 1*, t'^{l) = 2*. This 



is shown in Figure [2] where the left tree corresponds to ti, the middle one to 
t2 and the right tree corresponds to t^. 



and 



00 



SW := IJ(ST)'. 



1=1 
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1 ® 1 ■ ID 

Figure 2: The stochastic wood Wq in SW 



4.2 Construction of stochastic trees and woods 

We define an operator on the set SW, that will enable us to construct an ap- 
propriate stochastic wood step by step. Let w = (ti, . . . , t^) be a S-wood with 
ti = {t'-, t'l) for 1 < i < L Moreover, let ? G {1, ...,/} and j G {1, ... , /(t^)} 
be given and suppose that t'-{j) = 1* or t'-{j) = 2*, in which case we call 
the pair an active node of w. We denote the set of all active nodes of 
w by acn(w). In Figures for woods respectively trees (for example Figure 
[1]) these nodes are represented by a square (a filled square ■ for 1* and a 
simple square □ for 2*). Now, we introduce the trees t^+i = (t;_^]^, tj',^]^), 1^+2 
= (t;+2,tr+2) and t,+3 = (t;+3.tr+3) ^ ST by 

nd(t,+fc) = {l,...,/(t,),/(t,) + l}, 
t;+,H = t:(n), 2<n< l{t,), t;V,H = t'^n), 1 < n < 

{0 k=l 
r k = 2 
2* A; = 3 , 

for k = 1,2,3. Finally, we consider the S-tree t = ^t',t"^ given by i' = t^, 

but with t ' given by t '{n) = t'-{n) for n ^ j and t' (j) - 
Then, we define 

E(ij){ti, . . . ,ti) := (ti, . . . , tj_i, t, tj+i, . . . t/+3) 



1 t:'(j) = r 

2 t'!{j) = T 



and consider the set of all woods that can be constructed by iteratively 
applying the -E'(ij) operations, i.e. we define 



SW := <^ w G SW 



w = • • • ^(nji)Wo, n > 

for the Wq introduced above. To illustrate these definitions, we present some 
examples using the initial stochastic wood wq given in Figure [21 First, 
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2 ® 2 



2 □ 



1® 11 lO ID ID ID 

Figure 3: The stochastic wood wi in SW 



2® 2a 2n 2® 2a 2n 



1® !• lo ID ID ID la la 1 

Figure 4: The stochastic wood W2 in SW 



the active nodes of wq are acn(wo) = {(2, 1), (3, 1)}, since the first node 
in the second tree and the first node in the third tree are represented by 
squares. Hence, i?(3^i)Wo is well defined and the resulting stochastic wood 
wi = i?(3^i)Wo, which has six trees, is presented in Figure [31 Writing wi = 
(ti, . . . ,t6), the left tree in Figure [3] corresponds to ti, the second tree in 
Figure [3] corresponds to t2, and so on. Moreover, we have 



acn(wi) = {(2, 1), (4, 1), (5, 1), (5, 2), (6, 1), (6, 2)} 



(15) 



for the active nodes of wi, so W2 = i?(2,i)Wi is also well defined. It is presented 
in FigureHl In FigureEl we present the stochastic wood W3 = i?(4 i)W2, which 
is well defined since 

acn(w2) = {(4, 1), (5, 1), (5, 2), (6, 1), (6, 2), (7, 1), (8, 1), (8, 2), (9, 1), (9, 2)} . 

(16) 

For the S-wood W3, we have 

«Pnrw )-i 2)' (6' 1)' (6, 2), (7, 1), (8, 1), (8, 2), 1 

acn^wsj I (9,i),(9,2),(10,l),(ll,l),(ll,3),(12,l),(12,3) /• ^ 

Therefore, we present the stochastic wood W4 = i?(6,i)W3 in Figure O Hence, 
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Figure 5: The stochastic wood W3 in SW 




Figure 6: The stochastic wood W4 in SW 
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3 ® 3 a 3 □ 



2® 3n2n 3®2n 3a2n 3n2n2n2n 






ID ID ID ID 101010 

Figure 7: The stochastic wood W5 in SW 



we obtain 



acn( W4 1 



(5, 1), (5, 2), (6, 2), (7, 1), (8, 1), (8, 2), (9, 1), (9, 2), 

(10, 1), (11, 1), (11, 3), (12, 1), (12, 3), (13, 1), ). (18) 
(13, 2), (14, 1), (14, 2), (14, 3), (15, 1), (15, 2), (15, 3) 



Finally, we present the stochastic wood W5 = i?(6,2)W4 with 

(5, 1), (5, 2), (7, 1), (8, 1), (8, 2), (9, 1), (9, 2), (10, 1), (11, 1), 
acn(w5) = { (11, 3), (12, 1), (12, 3), (13, 1), (13, 2), (14, 1), (14, 2), (14, 3), 
(15, 1), (15, 2), (15, 3), (16, 2), (17, 2), (17, 3), (18, 2), (18, 3) 

(19) 

in Figure [71 By definition the S-woods wq, wi, . . . , W5 are in SW, but the 
stochastic wood given in Figure [His not in SW. 

4.3 Subtrees 

Let t = (t', t") be a given S-tree with nd(t) > 2. For two nodes fc, / G nd(t) 
with k < I we say that / is a grandchild of k if there exists a sequence ki = 
k < k2 <■■■< kn = I of nodes with n > 1 such that 



t'(A;„+i) = ky for v = 1, . . . ,n — 1. 
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1 ® 1 o 




Figure 8: Subtrees of the right tree in Figured] 



Suppose now that ji < ■ ■ ■ < jn with n > 1 are the nodes of t such that 
t'{ji) = root(t) for z = 1, . . . , n. For given i G {1, . . . ,n} suppose that 

ji = < ji,2 < ...< jiM < ^t), 

where k > I and ji^i, . . . are the grandchildren of ji. Then, we define 
the trees U = (t^,t") with /(tj) := /j such that 

ji,t[ik) = t'(ii,fc), t'-{k) = t"(j,,fe) 

for all A; G {2, . . . , k} and t"(l) = ^"{ji) for every i = 1,. . . ,n. We call 
the trees ti, . . . ,t„ defined in this way the subtrees of t. For example, the 
subtrees of the right tree in Figure [1] are presented in Figure El 

4.4 Order of a tree 

We also require the order of a stochastic tree and of a stochastic wood. For 
this we introduce a function ord : ST — * [0, oo) given by 

ord(t) := \{j G nd(t)|t"0-) = 1 or t"{j) = r}\ 

+ 7 |{j G nd(t)|t"(j) = 0}\+S\{je nd(t)|t"(j) = 2 or t"(j) = 2*}| 

for every S-tree t = (t',t") with t"(l) ^ and ord(t) := 7 for every S-tree 
t = (t', t") with t"(l) = 0. For example, the order of the left tree in Figured] 
is 2 + 7 + 25 (since the left tree has one node of type 0, two nodes of type 1 
respectively 1* and finally also two nodes of type 2 respectively 2*) and the 
order of the right tree in Figured] is 7 since its root is of type 0. In addition, 
we say that a tree t = (t',t") in ST is active if there is a j G nd(t) such 
that t"{j) = 1* or t"{j) = 2*. In that sense a S-tree is active if it has an 
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active node. Moreover, we define the order of an S-wood w = (ti, . . . ,t„) 
with ?T, > 1 as 

ord(w) := min |ord(ti), 1 < i < n|tj is active} . 

To illustrate this definition, we calculate the order of some stochastic woods. 
First of all, the stochastic wood in Figure [2] has order 6, since the middle tree 
and the last (the third) tree in Figure [2] are active. More precisely, the nodes 
(2, 1) and (3, 1) of the S-wood wq are active nodes and therefore the second 
and the third tree are active. The second tree in Figure [2] has order 1 (since 
it only consists of one node of type 1*) and the third three in Figure [2] has 
order 6. Hence, since S < 1, the S-wood wq has order S. Since the second 
tree and the last three trees are active in the stochastic wood wi in Figure [3] 
(see equation (|T5l) for the active nodes of wi), we obtain that the stochastic 
wood in Figure [3] has order 6 + min(7, 6). The second tree in wi has order 1 
and the last three trees in the S-wood wi have order 5 + 7, 6+1 respectively 
26. As a third example, we consider the S-wood W2 in Figure HI The active 
nodes of W2 are presented in equation f|T6|) . Hence, the last six S-trees are 
active. They have the orders 5 + 7, 6+1, 26, I + 7, 2 and 1 + 6. The minimum 
of the six real numbers is (5 + min(5, 7). Therefore, the order of the S-wood 
W2 in Figure m is also 6 + min(5, 7). A similar calculation shows that the 
order of the stochastic wood W3 in Figure [5] is 5 + mm{6, 27) and that the 
order of the stochastic wood W4 in Figure [6] is also 6 + min(5, 27). Finally, 
we obtain that the stochastic wood W5 in Figure [7| is of order (J + 2min(5, 7). 

4.5 Trees and stochastic processes 

To identify each tree in ST with a predictable stochastic process in V, we 
define two functions $, : ST V recursively. For a given S-tree t = 
(f, t") with k = t"(l) we define $(t) := /° when = or l{t) = 1 and, when 
/(t) > 2 and A; 7^ 0, we define 

m :=4"[$(ti),...,$(t.)], 

where ti, . . . , t^, n > 1, are the subtrees of t. In addition, for an arbitrary t 
in ST, we define ^'(t) := if t is an active tree and ^'(t) = $(t) otherwise. 
Finally, for an S-wood w = (ti, . . . , t„), n > 1, we define $(w) and \Ef(w) by 

$(w) = $(ti) + . . . + $(!„), ^(w) = ^(ti) + . . . + ^(t„). 
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As an example, for the elementary stochastic wood wq (see Figure [2]) we have 
<l>(wo) = /° + /?, + 4 and $(wo) = /°. (20) 
Hence, we obtain 

$(wo) = AU (21) 

from the equation above and equation (j6]). Since (3, 1) is an active node of 
Wo, we obtain 

<i.(wO = /° + /?. + /° + 4 [I'o] + 4 + 4 [4] (22) 

and 

vI/(wi) = /0 + /° (23) 

for the S-wood wi = £'(3 i)Wo presented in Figure [31 Moreover, in view of 
equations ([7]), ([HD, (© and ([lUD, we have 

<l>(w) = $(^(ij)w) (24) 

for every active node of a stochastic wood w G SW. Hence, we obtain 

$(Wi) = $(%i)Wo) = ^(wo) 

due to the equation above and the definition of Wi. Hence, we also obtain 
$(wi) = AU. And again equation yields 

<|)(W5) = $(W4) = ■ ■ ■ = <l>(wo) = AU 

by the definition of W5, . . . , wi. As an further example, we obtain 

Hw,) = /° + /? + /° + 4 [I'o] + 4 [4] + 4 [4] + 4 [/o°] + 4 [4] + 4 [4], 

(25) 

which is, since $(w2) = AU, nothing else than the expansion of the solution 
given by equation fill I) . However, in the expression of the right hand side of 
the equation (^^, the solution process {Ut)te[o^T] occurs, for example in the 
integrals ll* [Jq]. More precisely, in every integral of type 1* or 2*. Therefore, 
we use \l/(w2) instead of $(w2), which omits all these integrals, as a good 
approximation of the solution process. We have 

AU = $(W2) ^ ^(W2) = /o° + /? + II 
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We also note that the right hand side of the equation above is just the expo- 
nential Euler approximation in equation (IT^ . With the above notation and 
definitions we are now able to present the main result, which is a presenta- 
tion formula for the solution of the SPDE ([1]) by the Taylor expansion and 
an estimate of the remainder of the Taylor approximation. Hence, it can be 
seen that \1'(-) is indeed a good approximation of $(■). 

Theorem 1. Let Assumptions [J]^ be fulfilled. Let w be an arbitrary given 
stochastic wood in S W and let p > 1 . Then there exists a constant C > 
such that 

P [Ut = Ut, + $(w)(t)] = 1, \Ut - {Ut,, + ^(w)(t))|^, < C(At)°^<-) 

(26) 

for every t G [to,^]; where Ut, t G [0,T], is the unique solution of the SPDE 
([1]). Here the constant C > only depends on the S-wood w, on p > 1, on 
T > 0, on \F{0)\ given in AssumptionslE, on 6, (Lj)j>o given in Assumptions 
and on (i?j)j>i, (i^j)j>i given in equation (jlj). 

The representation of the solution here is a direct consequence of equa- 
tions (1211) and (1241) and the definition of SW. The proof for the estimate 
in fl26l) will be given in section [61 Here $(w) = AU is the Taylor expansion 
of the increment of the solution of the SPDE ([1]), while \E'(w) is the Taylor 
approximation of the increment of the solution and $(w) — \l'(w) is its re- 
minder, which are uniquely described by the S-wood w in SW'. Since there 
are woods in SW' with arbitrary high orders, Taylor expansions of arbitrary 
high order can be constructed by successively applying the operator to 
the initial S-wood wq. Finally, the result of Theorem [1] can also be written 
as 

Ut = Ut, + ^M + Oi{Atr''^^^) 
for t G [to, T] and a stochastic wood w G SW. 

5 Examples 

We present some examples here to illustrate the Taylor expansions introduced 
above and Assumptions [T]|H 

5.1 Abstract examples of the Taylor expansions 

We begin with some abstract examples of the Taylor expansions. 
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5.1.1 Taylor expansion of order S 

The first Taylor expansion of the solution is given by the initial stochastic 
wood wq (see Figure [2]), i.e. we have $(wo) = AU approximated by \l'(wo) 
with order ord(wo). Precisely, we have 

vl/(wo)(t) = (e^^* 

and 

J to J to 

almost surely due to equation (120]) . Since, ord(wo) = 5 (see section IDl4.4p . 
we finally obtain 

Ut = e^^^'Ut, + OiiAtf) 
as a Taylor expansion of order 6. Here t is always in [to, T]. 

5.1.2 Taylor expansion of order d + mm{'y,6) 

In the next step, we consider the Taylor expansion given by the S-wood wi 
(see Figure [3]). Here $(wi) and \E'(wi) are presented in equation fl22l) and 
f l23|) . Since ord(wi) = 6 + min(7, 5) (see section Bll4.4p . we obtain 

Ut = e'^^'Uto + r e'^^'-'^B{Uto) dWr + 0((At)(^+"^''^(^'^))) 

J to 

as a Taylor expansion of order 5 + min(7, 5). 

5.1.3 A further Taylor expansion of order 5 + min(7, 5) 

The stochastic wood W2 (see Figure S]) has order 5 + min(7, 5) (see section 
H1I4.4I) . Here the Taylor approximation \E'(w2) of $(w2) = At/ is given by 
\E'(w2) = Jq + J° + /2 and therefore, we obtain 

= e'^^'Uto + A-\e'^^' - I)F{Ut,) + f e^^'-"-^ B{Uto) dWr + C'((At)(^+"^''^(^'^))) 

J to 

as a further Taylor expansion of order 6 + mm{'j , 6) . This example corre- 
sponds in the case of additive noise to the exponential Euler scheme intro- 
duced in Jentzen & Kloeden (2008b), which was already discussed in section 
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[5)13.21 (see also equation (HM ). One could ask, why one presents this Taylor 
expansion here, if it is of the same order as the Taylor expansion above. 
The reason is the following: The local approximation quality of these both 
Taylor expansions is the same. However, for numerical schemes one has to 
consider the global approximation quality of a one-step numerical scheme 
induced by a local approximation. It turns out that the one-step numerical 
scheme induced by this Taylor expansion has very good global approximation 
properties, which can also be seen in Jentzen & Kloeden (2008b) in the case 
of additive noise and is a task for further research in the general case (see 
Remark [ID . 

5.1.4 Taylor expansion of order S + mm{2'j,5) 

In the next step, the stochastic wood W3 (see Figure [5j) has order 6 + 
min(27, 5) (see section [^4.41) . Moreover, we have 

^(w3)=/° + /? + /° + /2^[/0°] 

and hence, we obtain 

Ut = e^^'Ut,+A-\e^^'-I)F{Ut,)+ te^^'"^^B{Ut,)dWs 

Jto 

+ I e^^'-'^B'iUto) ((e^^^ - /) Uto) dW, + 0((At)(^+-i"(27,5))) 

Jto 

as a Taylor expansion of order 6 + min(27, 6). 

5.1.5 Taylor expansion of order 6 + 2 mm{'j , 6) 

Since W4 yields the same Taylor approximation as W3, i.e. \l/(w4) = \I'(w3), 
we present here the Taylor approximation for the S-wood W5 (see Figure [7]). 
We obtain 

Ut = e^^'Ut,+A-\e^^'-I)FiUt,)+ fe^^'-'^B{Ut,)dW, 

Jto 

+ I e^^'~'^ B' iUto) I e^^'~'-^B{Uto)dWrdW, 

J to J to 

+ f e'^^'-'^B'iUto) ((e^^^ - /) Ut,) dWs + 0((At)(^+2™'^(^'^))) 

Jto 
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as a Taylor expansion of order 6+2 min(7, S) (see section l^4.4l) . This example 
corresponds to the Taylor expansion introduced in section [51I3.3I 

5.2 Additive noise 

In the case of additive noise the stochastic trees and stochastic woods can 
be simplified. Therefore, a detailed presentation of abstract and concrete 
examples of the Taylor expansions in the case of additive noise can be found 
in Jentzen & Kloeden (2008c). 

5.3 Noise via multiplication operators 

As an example of our assumptions, we consider the stochastic heat equation 
with multiplicative space time noise in one dimension (see also section 2 
in Miiller-Gronbach & Ritter (2007a) for a very precise description of this 
example). Let if = ((0, 1), M) be the Hilbert space of all square integrable 
functions from (0,1) to M. The scalar product and the norm in H are given 
by 

{f,9) = f{x)g{x)dx, I/I = (^j^ f{xfdx 

for every f,g E H. We also define U := H. Moreover, let A = A be the 
Laplacian with Dirichlet boundary conditions in one dimension, i.e. X = N 
and 

ei{x) = V2sm{i7vx), Aj = tt^z^ 
for all x G (0, 1) and all z G N. The operator A is then given by 

for all / G D{A) with D{A) = {f e H \ Y^r^i l(e*, f)? < oo} and in that 
way Assumption [1] is fulfilled. Furthermore let -F = and we define B by 

B:H^L{H,D), {B{v){w)) (x) := v{x) ■ w{x) (27) 

for every x G (0,1) and v,w & H, where D = L} ((0, 1),M) is the Banach 
space of all integrable functions from (0, 1) to M. Indeed, B is well defined. 
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since 



\B{v){w)\^ = J \v{x) ■ w{x)\dx < \v{x)f dx^ (^j \w{x)\^ dx^ 
= \v\ ■ \w\ 

for all v,w E H due to the inequality of Cauchy-Schwartz and therefore B[v) 
is indeed a bounded linear operator from H to D with \B{v)\^JJ < \v\ for 
all V E H. Even more, by definition, also i? is a linear operator from H to 
L{H, D). In particular, it is infinitely often differentiable with the derivatives 
B'{v) = B and B^'\v) = for alH > 2 and every v E H. Furthermore, it is 
straightforward to verify that {— A)'^ e"^^ B (v) is a Hilbert-Schmidt operator 
from H to H with 

|e^*S(t;)|^^ < 4(T+1) \v\t--^, | (-y4)^e^*S(w) < 4(T+1) \v\t-^-^+^^ 

for every v e H, t e (0,T], 7 G (0, |) (see Jentzen & Kloeden (2008d) 
and also Remark 2 in Miiller-Gronbach & Ritter (2007a)). Hence, since 
L^(0,1) C D{{—A)^^2^) continuously. Assumptions [2] and [3] are also fulfilled 
with the parameters 7 = | — r and ^ = | for an arbitrary but very small 
r > 0. Now, we present the abstract Taylor expansions in section OEH in that 
particular situation. First of all, the Taylor expansion in section [Sll5. 1115. 1.11 
is here given by 

/7i = e^^*[/,„ + 0((At)i). 

Here t is always in [to, T]. In the next step, we consider the Taylor expansion 
in section [5)15.1115.1.21 respectively 15115.1115.1.31 which is here given by 



Ut = e^^'Ut, + f e^^'-'^B{Ut,) dWr + 0{{At) 



Moreover, we have 



Ut = e^^'Ut,+ f e^^'-'^B{Ut,)dWs 

+ I e'^'~'-'^B{{e^^' -l)Ut,)dWs + 0{{At)^) 

Jto 

= e''^'Uto+ [ e^^'-'^Bie^^'Ut,)dWs + 0{iAtf2] 

Jto 
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for the Taylor expansion in section [S1I5.1II5.1.4[ Finally, we obtain 

Jto 

+ e^^'-'^B e^^'-'-^BiUj dWr^ dWs + 0((At)(t-2^)) 
for the Taylor expansion in section [5ll5. 1115.1. 51 

Remark 1. For further research, it would be interesting to analyze the nu- 
merical one-step scheme induced by the Taylor expansion in sectionW iS. IViS.l.'M 
Let = to < ti < ■ ■ ■ < tN = T be given discretization times. Then, one 
could consider the scheme (X„)„>i given by Xq = uq and 

= e^(*"+i-*")X„ + / e^(*"+^-'')S(X„) dWr 

J tn 

for n = 0, 1, . . . , — 1. Of course, this is just a discretization in time, but 
for the space discretization one could use standard methods such as spectral 
Galerkin methods. Note also that the second summand in the scheme given 
above is an ltd integral with an integrand that is J-'t„-measurable and therefore 
the conditional distribution of this integral (with respect to J-'t,J is normal. 
Although it was shown in the seminal paper Davie & Gaines (2000) that even 
for a large class of linear functional the computational order barrier of | 
(convergence speed of the linear implicit Euler scheme) cannot be overcome in 
this special example, there is still hope that this numerical scheme converges 
with a higher order, since the linear functionals above do not fit in the class 
of linear functionals used there. Therefore, from my point of view, it would be 
very interesting to analyze the convergence order of the scheme given above. 



6 Proofs 

In the following, we need a version of the Burkholder-Davis-Gundy inequality 
in infinite dimensions (see Lemma 7.7 in Da Prato & Zabczyk (1992)). 

Lemma 1. LetXt, t G [to)2^] be a predictable stochastic process, whose values 
are Hilbert- Schmidt operators from U to H with E jJ^\Xs\^^gds < oo. Then, 



X dW. 



to 



< p 



LP 



\x 



s\HS\Lp 



ds 



to 
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for every t E [to, T] and every p > 2. (Both sides could be infinite.) 
6.1 Proof of Theorem [1] 

In view of the definitions of the mappings $ and the proof of the Theorem 
[T] immediately follows from the next lemma. 

Lemma 2. Let AssumptionsU]^ be fulfilled. Let t = (f, f) be a given S-tree 
and let p > 1 . Then there exists a constant C > such that 

for all s G [toi^"], where C > only depends on the S-tree t, on p > 1, on 
|F(0)| given in Assumptions\^ on 5, (Lj)j>i given in Assumptions\^ and on 
{R)i>i,{Ki)i>i given in equation (jl]). 

Proof. We can assume without loss of generality that p > 2. Throughout 
the proof C > is a constant changing from line to line but only depends on 
|F(0)|, 5, (i?i)i>i, p, t, (Lj)j>i and (i^i)j>i. We will prove the assertion by 
induction with respect to the number of nodes /(t). 
Let s G [^0)7"] and suppose that k = t"(l). Then, by Lemma [H we have 



< Rp {Asy < C{As)\ 
/ e'^^'-'^F{Ur)dr < / \e'^^'''^F{Ur)\^,dr< {\F{Q)\ + K^p^^,) dr 

J tn TP J tn J tn 



LP k) k) 

< i\F{0)\ + KoRp){As)<CiAs) 
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and 



J to LP \Jto J 

< Lop(^J\l + \UrU'{s-rY''~'Ury 

< {l + R,)Lop(^J\s-rY''-'Ury 

= ((i±^j (A.)'- < C(A,)'. 

This yields |$(t)(s)|j^p < C(As)°"^^(*) when A; = or l{t) = 1 since by defini- 
tion $(t) = here. 

Suppose now that l(t) > 2 and A; 7^ 0. Let ti, . . . , t„, n > 1, be the subtrees 
of t. Then, by definition, we have 

^(t)(^) = /n*(ti),...,*(t„)] (s) 

for s e [^0, When A; = 1*, we have 

$(t)(.) = e^(-'-) (^^' fW(C/,„ + MC/,) ($(tO(r), . . . , $(t„)(r)) ^^(^3^ rf^) 



and therefore 



\mi^)\<Kn r\m)ir)\---mK){r)\dr. 



Hence, we obtain 



|$(t)(.)|^, < ||$(tO(r)|---|$(tn)(r)||^. c/r 

J to 

< Kn / |$(ti)(r)|^,„---|*(t„)(r)| Lpn dr 

J to 
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since /(ti), . . . , /(t„) < l{t) — 1 and we can apply the induction assertion to 
the subtrees. A similar calculation shows the result when k — 1. 
When k = 2*, we have 

mis) = e^^-'-) B^-\U,, + em) ($(ti)(r), . . . , $(t„)(r)) il-^l^rf^^ dW, 
and therefore 

\m{s)\L. 



LP 
1 

2 



1 

2 \ 2 



It U! 1 1"^^'"''^^^"^^^*^ + ^^^^^ (*(ti) W> • • • > ^(tn)(r)) dr 

)^''-'^ ^^'\{l + \U,, + 0AUr\)mt,){r)\...mK)ir)\\^^de^ dr 



< L^p I / [s-r 
Since 



' 1(1 + \U,, + 9AUr\) |$(ti)(r)| . . . |$(t„)(r)||^, d9 



<- f 

Jo 



(1 + \Ut, + eAUrlL.c^+r,) |<l>(ti)(r)|^,(„+i) ■ ■ ■ |$(t„)(r)|^,(„+i) dd 

< c'(^_io)(-d(*i)+-+-d(*")) [\i + \eUr + {i-0)Ut,\L,^r.+^))d0 

Jo 

< C (1 + (r - to){o=^d(ti)+...+ord(t„)) < (^^^^^){ord{ti)+...+ord(t„)) 

for every re [to, s] due to the induction assertion, we obtain 

|$(t)(s)|ip < C (^J\s - rf^-^^ dr^ ' (^^)(ord(ti)+-+ord(t„)) 

A similar calculation shows the result when k = 2. □ 
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